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r . Abstract 

H 

^Q ■ Wc establish a simple variance inequality for U-statisties whose underlying se- 

quence of random variables is an ergodic Markov Chain. The constants in this 
inequality are explicit and depend on computable bounds on the mixing rate of 
the Markov Chain. We apply this result to derive the strong law of large number 
for U-statistics of a Markov Chain under conditions which are close from being 
optimal. 
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. . 1. Introduction 

^D \ Let {^nl^o t>e a sequence of random variables with values in a measurable 

space (Y, 3^). Let m be an integer and h : Y™ ^' M be a symmetric function. 
For n > m, the U-statistic associated to h is defined by 



>< ; Un,rn{h) = r] Y. ^^^^^ ^ ---^y^J- (1) 

3 . l<ii<-<im<n 



The function h is often refe rred to a s the k e rnel of the U-sta tistics and m is called 
the de gree of fe. Wc refer to lSerfling|(jl98Cl( ). lLeel(|l990l ). and lKoroliuk and Borovskich 



(|1994) for U-statistics whose underlying sequence is an i.i.d. sequence of random 



variables. 
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Several authors have studied U-statistics for stationary sequenc es of de 



pende n t random variables under different dep endence conditions: see lArcones 



|l998l) , iBorovkova et alj (|200ll) , iDehlind (|2006h and the references therein. Much 



less efforts have been spent on the beha vior of U-statistics for n on-s tationary and 

asymp totically stationary processes; see lHarel and Puril ( 19901 ) and lElharfaoui and Harel 



(|2008l) . In this letter, we establish a variance inequality for U-statistics whose 



underlying sequence is an ergodic Markov Chain (which is not assumed to be 
stationary). This inequality is valid for U-statistics of any order and the con- 
stants appearing in the bound can be explicitly computed (for example, using 
Foster-Lyapunov drift and minorization conditions if the chain is geometrically 
ergodic). This inequality can be used to derive, with minimal effort, limit the- 
orems for U-statistics of a non-stationary Markov chain. In this paper, for the 
purpose of illustration, we derive the strong law of large numbers (SLLN) under 
weak conditions. 

Notations 



Let (Y, y) be a general state space (see e.g. (jMevn and Tweedid . l2009l 



Chapter 3)) and P be a Markov transition kernel. P acts on bounded measurable 
functions / on Y and on measures fi on 3^ via 

Pf{x) 1^' J P{x, dy)f{y) , fiP{A) "^^^^ J fi{dx)P{x, A) . 

We will denote by P" the n-itcratcd transition kernel defined by induction 

P"(x,A) ^^ j P''-\xAy)P{y.A) ^ Jpix,dy)P"-\y,A) ; 

where P° coincides with the identity kernel. For a function y : Y ^ [1, +oo), 
define the F-norm of a function / : Y ^ R by 

|/|^1^%up|/|/t/. 

Y 

When V = 1, the V^-norm is the supremum norm and will be denoted by |/|oo- 
Let Ly be the set of measurable functions such that |/|y < -|-cxd. For two 
probability measures /xijM2 on (Y, 3^), ||/ii — /X2||xv denotes the total variation 
distance. 

For fi a probability distribution on (Y, y) and P a Markov transition kernel 
on (Y, y), denote by P^ the distribution of the Markov chain (y„)„gi^ with initial 
distribution /.i and transition kernel P; let E^ be the associated expectation. 
For p > and Z a random variable measurable with respect to the cr-algebra 
a((r„)„,j,),set||Z||^/=|f(E^Pn)i/^ 

2. Main Results 

Let P be a Markov transition kernel on (Y, y). We assume that the transition 
kernel P satisfies the following assumption: 



Al The kernel P is positive Harris recurrent and has a unique stationary 
distribution tt. In addition, there exist a measurable function V : Y ^ 
[l,+oo) and a nonnegative non-increasing sequence (p(fc))^gpj such that 
lini„ p(n) = and for any probability distributions /i and /i' on {Y,y), 
and any integer k, 

ll/iP'^ - m'^Itv ^ ^(^) [a^(^) + A^'(^)] ' (2) 

and 

tt{V) < oo . (3) 

A2 The function h is symmetric and 7r-canonical, i.e, for all (yi, . . . ,2/m-i) G 
Y"*-!^ y h^ h{yi, . . . ,ym^i,y) is 7r-integrable and 

7r(dy)/i(yi,...,2/™_i,2/) =0. (4) 



For fi a probability measure on (Y, 3^) , we denote 

M{ti,V)'':^'supfiP'{V). (5) 

fc>0 

Note that, under A[l] for any probability measure /i on (X, X), tt{V) < M{ijl, V). 
We can now state the main result of this paper, which is an explicit bound for 
the variance of bounded 7r-canonical U-statistics. The proof of Theorem 12.11 is 
given in Section [31 

Theorem 2.1. Assume J^J^ If \h\oo < oo then, for any initial probability 
measure fi on (Y, 3^), 

||f/„,m(/l)||,,2 < Cn^rnVM{fi,V)\h\^n-"'/^ (6) 

with 

/ n \ ^/^ m 

C„,^ l^f 2^2+1^(2^ ^(fc + lynp^k) ^ . (7) 

Remark 1. In the case where p{k) = g'' for some g G (0, 1), for all (m, n) E N, 

1 m™+i - (-ln(g))™+i 



J2ik + irpik)< 



g {- \n{g))"^+^ m + \n{g) 

We may extend Theorem 1 2. II to symmetric functions h which are not canon- 
ical. For any integer p and any pi, . . . , pp, p (signed) finite measures on (Y, 3^), 

denote by /^i • • • O ^p = ®f^j pi, the product measure on (Y^, y^P). For p 

a (signed) finite measure on (Y, y), define /x®p ~ /i • • ■ (g) /i. 



Let h : Y™ — > M be a measurable and symmetric function such that 7r®™(|/i|) < 
oo. Define for any c S {1, . . . ,m ~ 1} the measurable function 'Kc,mh : Y'^ — ;■ R 
given by 

7r,,„/i(2/i , . . . , y,) =' {5y, - ^) ® ■ ■ ■ ® (<5,, ~ n) ® ^^^(m-c) ^^^ ^ (g) 

where for any y ^y^ 5y denotes the Dirac mass at y. Set 

TTo,mh = 7r®™/i and TTm,„ih{yi, . . . ,y,n) = (^{Sy, -7r)[/i] . (9) 

Note that for any c S {1, . . . , m} 'Kc,mh is a 7r-canonical function. The HocfFding 
decomposition allows to write any U-statistics associated to a symmetric fu nc- 
tion h as the following sum of canonical U-statistics (see e.g. ( Serfling| . ll980l . p. 
178, Lemma A)): 



> c 

c=0 



Un,m{h)^Y.\ jUnA^c.rnh) , (10) 



dcf 



where Un,c is defined in ([T]) when c > 1 and Un.oif) ~ ./■ The symmetric 
function h is said to be d-degenerated (for d G {0, . . . ,rn}) if 'Kd,mh ^ and 
iTc,mh = for c G {0, . . . , d — 1}. By construction, a 7r-canonical function h is 
?7i-degenerated (it is also said "completely degenerated" ) . 

Corollary 2.2. Assume j4[7J Let h he a hounded symmetric d{h)- degenerated 
Junction. Then 



c 

c=d{h)Vl ^ 



where Cn,c is defined in ([7])- 

It is possible to extend the previous result to unbounded canonical functions. 
Define, for any g > 1, 

Bq{h) - sup , (11) 

tei,...,a™)eY'" l^j=i V'/'i{yj) 

where V is defined in A[TJ The proof of Corollary 12. 31 is given in Section |31 

Corollary 2.3. Assume J^^J^and that, for some p € [0,oo), B2(p+i){h) < oo 
holds. Then, for any initial probability measure fj, on (y,y), 

/ n \ 1/2 ^^2 

\\U„,r,.ih)\\^^,<2"^/'my^(2my.Dip,^,V,h) K](fc + 1)™ (p(A;)) (^ ^ 

\fc=0 / Vm/ 

where the constant D{p,fi, V, h) is given by 



dof „j£±i^ 



Dip,fx,V,h) = 2^i^ p—+p~— VMXMO S2(p+i)(/i) . (12) 



1/2 



Using again the Hoeffding decomposition ([TU)) . Corollarv l2.3l can be extended 
to the case when h is d-degenerated for d G {0, • • • ,m — l}. Details are left to the 
reader. When used in combination with explicit ergodicity bounds for Markov 
chains, Theorem 12.11 and the corollaries can be used to obtain non-asymptotic 
computable bounds for the variance of U- and V-statistics. As a simple illus- 
tration, assume that the transition kernel P is phi-irreducible, aperiodic and 
that 

1. (Drift condition) there exist a drift function V :Y ^ [1,+cx)) and con- 
stants 1 < & < oo, and A G (0, 1) such that 

PV <XV + b. 

2. (Minorization condition) for any d > 1, the level sets {V < d} are petite 
for P. 

Then, there exists a probability distribution tt such that ttP — tt and n{V) < 
6(1 — A) ~"'^. In addition, there exist computable constants C < oo and p G (0, 1) 
such that for any probability measures /i, fi' on (Y, y) and any n > 0, 

UlP'^-^i'p^^y<Cp-Hv) + ^,'{v)] ; 



(see fo r example lRoberts and Rosenthall (|2004h . lDouc et al.l ( 20041 ) or lBaxendale 



( 20051 )). Assumption A[T] is thus satisfied with p{k) ~ Cp^ and we may thus 



apply Theorem l2.1l to obtain a non-asymptotic bound. 

It can also be used to derive limiting theorems for U-statistics of Markov 
chains. In what follows, as an illustration of our result, we derive a law of 
large numbers which holds true under conditions which are, to the best of our 
knowledge, the weakest known so far and more likely pretty close from being 
optimal. 

Theorem 2.4. Assume ^4(7] with p{n) = O (n~'") for some r > 1. Let m > I 
and h : Y™ — > M &e a symmetric function such that for some 6 > 0, 

sup rn -,.. ^ < OO . (13) 

Then, for any probability measure p on (Y,^) such that M(p, V) < oo, 






■ M 



when n — > +cx) an 
-1 



-a.s. 



(14) 



n 



TT{dyi)---TT{dym)h{yi,--- ,ym) ■ (15) 



l<.ii <---<i„i<n 



3. Proof of Theorem [Hi] and Corollary [2731 

For any probability measure /i on (Y, 3^) , for any positive integer (. and any 
ordered ^-uplet fco = < fci < • ■ • < fcf , consider the probability measure 
pfei,fc2,...,fc(! fiefined for any nonnegative measurable function / : Y^ ^- R+, by 

if) ^^ j -j /^(dyo) n ^''-"-Hy.-i, dy.O/(yi:.) , (16) 



i=l 



dof 



where yij = (yi, . . . ,yi). Note that, by construction, 

For any positive integer m and any ordered 2m-uplet I=(l<Ji<i2<'''< 
i2m), we denote for £ G {1, . . . , m}, 

it{I) = niin(i2f-i - i2«-2,«2f - J2<?-i) , (17) 

J, (X) =' max [ji (X) , J2 (X) , . . . , J™ (X)] , (18) 

where, by convention, we set zq = 1. Denote by ,B+(Y^™) the set of nonneg- 
ative measurable function / : Y^™ — )• R+. For any probability measure /j, on 
(Y, 3^) and any ordered 2m-uplet I, denote Pj = p*i'-"'2m^ -^g consider the 
probability measure P^ == pi.-'i^n. on (Y2™,3;®2m-) g-^g^^ f^^. y ^ g_^(Y2™) by 

P^(/) =' /7r(dyi)P^--''-(dy2:2,n)/(yi:2™) , (19) 

if inf {fc e {1, . . . ,to},j4Z) = jfc(X)} = 1 and 

Pj(/) =■ I ^M '■■■''""' (d2/l:2€-2)7r(dy2f_l)P;-'-''-(dy2£:2™)/(yi:2™) , (20) 

if £ = inf {fc e {1, . . . , m\,ji,{I) = jki^)} G {2, . . . , m}. For any permutation a 
on {1, ... , 2m}, define U ■ Y^™ ^ M the function 

faiyi,---,y2m) = /l(y<T(l),---,y^(m)) /^(y^(m+l),---,y<T(2m)) • (21) 



any ordered 2TO-uplet I and any permutation ct, 



Since the function h is 7r-canonical, it follows from the definition of P^ that, for 



■ /J 



(/.) = . (22) 



This relation plays a key role in all what follows and is the main motivation for 
considering the probability measures Pj. 



Proposition 3.1. Assume j4[7]-^4[^ Then, for any probability measure fi, any 
positive integer n and any ordered 2m-uplet X in {1, • • • , n}, 



ji _ pi 
■ (1 ^ ^ 



TV 



<Ap{J4I))Mi^^,V) 



(23) 



where the sequence {p{n))ni=n, M{fi, V) and ji,{X) are defined respectively in ^, 
®, and dUl). 

Proof. Let I ~ (1 < ii < «2 ^ • • ■ ^ *2m ^ n). To simplify the notation, in 
what follows, the dependence in X of ji, . . . , j™ - defined in l\n\ - is implicit. 
Assume first that j^, — ji . 

Let / e S+(Y2'"). The definition of ^ implies that 

Pj(/) =' P;— ■'^-(/) = |MP'Udyl)P;=^^-^-■•'--'Kdy2:™)/(yl:2n^) • 

Combining this expression with the definition ([T9| of Pj yields 



(/)-Pm(/) 



<Ti+T2 



(24) 



with 



Ti 



dcf 



dcf 



_ 



[//P'i(dyi) - 7r(dyi)] P;--^-"(d2/2:2,„)/(yi:2rn) 



/iP^Hdyi) [Pr'"-"''""'ndy2:2™) -P;r-*^'"(dy2:2™)] f{yi:2,n) 



Consider first Ti. Since |/P;^-''^"(d2/2:2m)/(yi:2rn)| < |/|oo, AEand © imply 
that 

Ti < \\^lP''' - ^ll^y I/loo < P(*i) [Ai(^) + 7t{V)] I/Ioo < 2p(ii)A/(M, 1^) , 

where we have used that n{V) < M(/x, V) and tt{V) < M{p,, V). On the other 
hand, for any bounded measurable function g : Y^™~^ -^ R, and y € Y, 

Pr^"--'^"-'n5)=/'^y(dyi)P^^~^^(yi,dy2)P;r'"-''''""''(dy3:2™)5(y2:2™) 

and 

P^^'-'^^-ls) = y'M^'Udyl)P^=-^H2/l,dy2)P^^-■''--»Hdy3:2™)5(2/2:2n^) . 
Therefore, under A[T1 

- (5) - P;"-''^- (.g) I < P(*2 - h) [i^(y) + mP^^ (1^)] Isloo . 



Jl2-Il,---,*2m-!l I 



Integrating this bound shows that T2 < 2p{i2 — ii)M{iJ., V)\f\oo, where M{iJ,, V) 
is defined in ([5]). In conclusion we get 



(/) - Pj(/) < 2 [p(z2 - ^l) + Pi^l)] M(m, V) \fU 



(25) 



Assume now that, for some ^ S {2, . . . ,m.}, j* = je- With these notations, 
for any nonnegative function / : Y^™ — > R, 



Plif) 



Tlll,...,l2l-1 I 



(dyi:2^_i)P;-:;— ^^-"-'--^ (cly2,:2„0 / (yi:2„) 



Combining this expression with the definition ((20)) of Pj, we get 



;(/)-PJ(/) 



< Ti + r2 



(26) 



with 



Ti = 



])ll,...,l2«-2 



(d2;i:2£-2)[P'^'-^"''^*-Hy2«-2,dy2^_i) - TT{dy2e-i)] 

X P;?^'-''^'"(d2;2£:2™)/(yi:2m) 



and 



n 



"'(d?;i:2£-l) 



])»2f — «2f-l,---,l2m— 12«-1 
■ !;2('-l 



(dy2£:2m) -Pjr'''--'^'"(dy2^:2m) /(j/l:2m) 



Consider first Ti. Under All] (l2|), for any y2i-2 G Y, and any bounded measur- 
able function g : Y i— > R, 



[P"''-'~'''-Hy2i-2,dy2i^i) - 7r{dy2i-iMy2i-i) 

< p {i2i-i - i2e-2) [^(y2£-2) + 7r(y)] \g\c 
Applying this relation with 

5^1:2^-2(2/2^-1)= / ■•■ / Pu'""''""(dy2^:2m)/(2/l:2^-2,y2^-l,2/2^:2m) , 



and using that, for any yi:2e-2 G Y 



2£-2 



\9yi.. 



< I/loo, yields to 



Ti < p(i2,_i - i2e-2) [^iP'''-' {V) + 7r(y)] I/loo 

< 2p(z2£_i - i2£_2)M(/i, V)\f\oo ■ 

Consider now T2. Note that, for any bounded measurable function g : y2m~2i+i 
R that 



.^2^,^-»2.-i,.....2™-.2.-i(g) = j P'''-'''^'iy2i-i,dy2i) 

xFif^;--''"-'^--'^^{dy2i+l:2m)g{y2i:2m), 



and 



Therefore, under .A[l] for any bounded measurable function g : \'^'m--2i+i _^ 
and y2e-i e Y, 

< p{i2(i - i2i-i) [V{y2t-i) + Mi^ji, V)] \g\^ . 

Therefore, by integrating this bound with respect to p^i'-'*2f-i yields to the 
bound 

T2 <2p{l2i - l2i-l)M{lJL,V)\f\oo , 

which concludes the proof. D 

Lemma 3.2. Let (X, X) he a measurable space. Let ^ and (J he two prohahility 
measures on (X, A") and p G [0, +00). Then, for any measurahle function f 
satisfying ^(1/1^+^) + ^'(1/1'+^) < ^, 

m) ' eif)\ < c{p) [mm + em^n] "^'^'^ u - ir^^'"-'^ , 

where C{p) =' [pVCP+i) +p-P/(P+i)]. 
Proof. For any A/ > 0, 

w) - af)\ < M wi - c'iitv i/Ioo + i [i/ii{i/i > M}] + i' [\f\n\f\ > m]] 
< M lie - c'iitv i/u + M-p [e(i/r+^) + e'(i/r^)] • 

The proof follows by optimizing in M . D 

Proposition 3.3. Assume J^^J^ Then, for any ordered 2m-uplet I ~ {I < 
ii < ■ ■ ■ < 12,11 < n), any permutation a on {!,..., 2m}, and any initial distri- 
bution jjL on (Y, 3^), 

\&^[f,{Y,,,...,Y,,J]\<AM{^Ji,V)p{].{I)) \h\l , (27) 

where the sequence {p{n))„<£N, the index J* (I) and the function f^ are defined 
in ^, (|18p . and (j2ip . respectively. If, for some p £ [0,oo), the constant 
i?2(p+i)(ft.), defined in (jlip is finite, then 

|E^[A(K,,,...,r,,„)]| <m2 D{p,p,V,hf{p{j,{I)))T^ (28) 

where the constant D{jp, p^V^h) is defined in p2p . 



Proof. The proof of ^7\ follows immediately from (P^ and Proposition 13.11 

By applying the inequality ab < l/2(a^ + b^) and the Jensen inequality, it 
follows from A[2]that 



2m 



where fa is defined in ([2T|). Therefore, for any ordered 2m-uplet I = {I < ii < 
■■■ < i2„i < n), 



ip+i 



ip+i 






(29) 
(30) 



The proof then follows by using ([^ and by applying Proposition 13.11 and 
Lemma [221 D 



Proof of Theorem \2.1\ and Corollary \2.3\ Denote by r(2?Ti) the collection of all 
permutations of 2m elements. We have 



E,, 



^ /i(y,,,...,y,,j 



< 



J2 E K{KY^,i^V■■■^Y■^^i^■>WY^„ 

crGr(2m) l<ii <---<i2m <" 



■ '^i<T(2m))j| 



Let fc > 0. Denote by 1^ „ the set of all ordered 277i-uplet X = (1 < ii < • ■ • < 
«2m < n) such that j*{I) = k, where j,t(X) is defined in ([TS]) . By definition, 
for I G !„ „, and ^ G {l,...,m}, J£(X) < fc. It is easily seen that the cardinal 
of 1^ „ is at most 2'"n'"(fc + 1)'". The proof of Theorem 12.11 follows from 

Proposition [331 (EB- 

The proof of Corollary [231 follows from Proposition [331 dM])- □ 



4. Proof of Theorem 12.41 

We will use the following elementary Lemma. 

Lemma 4.1. Let (sn)neN ^^ '^ non- decreasing sequence of real numbers. Let 
(■Wn)„gpj be a non- decreasing sequence of positive numbers. Assume that 

• the sequence (ln(u„)/ln(n)),jgj^ converges to a positive limit 6. 

• for any a> 1, the sequence ( ""un [^[q"] ) converges to L. 
Then, the sequence (w~^s„) -^ converges to L. 



10 



Proof. Let a > 1. For any n £ N, denote by fc„ = supjfc G N, [a^^J < n}. 
Since the sequences (s,i)„gp^ and (u„)„g]^ are non decreasing and u„ > for any 

nGN, 



Since limn^^ooWLan+ij/wLQ"] = "' 

1 



<5 



tL < liminf — ^ < linisup ^^ < a L 



^11 n ^71 



□ 

Proof of Theorem \2.4\ Note that the positive and negative parts of h satisfy the 
conditions of Theorem l2.4l so that we can assume without loss of generahty that 
h is non negative. 



Proof of iJ5)) . For any r > 0, denote 

hr{yi,...,ym) = /i(yi,...,2/m)l{|/i(yi,...,y,„)|<T} 
By jA[1] we have, for any 1 < ii < ■ ■ • < im ^ n, 






n-l/ 



where by convention, iq ~ 0. Note that J2i<i <i <n P(*2 — h) = J2k=ii 
k)p{k) < nJ2^=i p{k). Therefore, 



^ E^[/i,(r,,,...,r,„)]-^«™[/ir] 

l<ii <---<im <''^i 

m / \ -1 



ra 



<2M{fi,V)Tj2 



j — l l<zi <■■■<!„, <n 

-1 

771 — 2 



TO 



n 



J — 1 l<2j_i<2j<n 

-1 n 



< 



2M{p,V)tY, 



j=i 






/£=1 



which goes to zero since n ^ X]fe=i P{^) ^ 0- Under the stated assumptions, 
there exists a constant C such that 



E„ 



HY^,..J\^\KiY„.,^)\>r} < C (log+ t) 



-(1+A-) 



Since lim^^^o 7r®™[/i^] = 7r®"[/i], the proof follows. 



D 



11 



Proof of |j^[ ). Let tti > 1 be fixed. We prove that 

J2 h{Y,,__J^n^"^[h] 



lira 



— a.s. 



(31) 



Using Lemma 14. 1[ we have to prove that (pij) holds if for any a > 1 , 



lim 

fe-i-+oo V m 



dcf 



^ h{Y,,.J=7r^"'[h] P^-a.s. (32) 

l<il<---<im<4>k 



where (j>k = [ct'^l- By the Hoeffding decomposition (jlOp . it suffices to prove 
that for any c G {1, • " ' i 'ti}, 



lim 



^ 7r,,„/i(y,i J ^ 

l<ii<---<V<0fc 



where iTcmh is the symmetric 7r-canonical fmiction defined in ([Sj; note that 
under (fHl). 



kc,m/i(2/i,--- ,2/c)| log+(|7rc,,„ft.(yi,--- ,yc)|)^+'' ^ , .„„^ 

sup =^c — 77^^^^ < +00 . (33) 

(wi,-,Wc)eY= }^i=iV[yt) 

The case c = 1 is the er godic theorem for Markov Chain (see for example 
(|Mevn and Tweedid . [JOOJ Theorem 17.1.7)). 

We consider now the case c G {2, • ■ • ,m}. In all what follows, the index 
c e {2, . . . , m} is given and for ease of notations, we denote by g an arbitrary 
TT-canonical symmetric function of c variables . Take s > such that 



2s < r - 1 



(34) 



By i^and (|55|) . there exists a constant C depending upon s and M{fi, V), such 
that 



E„ 



fc— 1 l<zi<---<ic<0fc 



c E(iog 



<U > (lOg^fcj 

fc=l 
and the RHS is finite since a > 1 and 6 > 0. Therefore, 

•^r J2 5(^»i:Jl{|ff(y,,^j|>0|} -> P^-a.s. 

l<ii<---<ia<<t>k 



-5-1 



We must now prove that 






— a.s. 



(35) 



(36) 



(37) 
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dof 



where for t > 0, grivi-.c) = 9{Vi:c)'^{\g(yi:a)\<T}- Wc apply again the Hoeffding 
decomposition (jlOp to the function g^s . Observe that since g is 7r-canonical, 
satisfies p3p and tt{V) < +00, the dominated convergence theorem imphes that 
hmfe7r®'=(g0=) = 7r®'=(g) = 0. Hence, by ([TO]), the hmit ^ holds provided for 
any £e {!,••• ,c}, 



lim ( 

A:— ^00 



^ ne.Ag^sJY,,.J=0, 



(38) 



l<ii<---<ii<4>k 

Since g is tt canonical, for £ G {1, ■ • ■ , c — 1}, we have Tr^.cg = which implies 



7r£,c[ff</.|] = T^e,, 



5-5l{ 



l9l>-#'fc} 



'Tl'f,, 



5l{|9l>0|} 



Therefore, (p8| is equivalent to 



lim ( 

A;— >oo 



^ 7rf,c[5l{|g|>0|}] =0, 



l<ii<---<ie<<pk 



which holds true by using an argument similar to (j35p : details are omitted. 
When £ = c,hy definition of tt^c (see ^) we have by applying Theorem 12. II 



E„ 



l<il<---<ia<4>k 



which by ([M)) implies (pS]) when £ = c. This concludes the proof. 



□ 
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